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We investigated whether intensive computerized cognitive training in schizophrenia could improve working 19 
memory performance and increase signal efficiency of associated middle frontal gyri (MFG) circuits in a function- 20 
ally meaningful manner. Thirty schizophrenia participants and 13 healthy comparison participants underwent 21 
fMRI scanning during a letter JV-back working memory task. Schizophrenia participants were then randomly 22 
assigned to either 80 h (16 weeks) of cognitive training or a computer games control condition. After this inter- 23 
vention, participants completed a second fMRI N-back scanning session. At baseline, during 2-back working 24 
memory trials, healthy participants showed the largest and most significant activation in bilateral MFG, 25 
which correlated with task performance. Schizophrenia participants showed impaired working memory, 2G 
hypoactivation in left MFG, and no correlation between bilateral MFG signal and task performance. After training, 27 
schizophrenia participants improved their 2-back working memory performance and showed increased activa- 28 
tion in left MFG. They also demonstrated a significant association between enhanced task performance and right 29 
MFG signal, similar to healthy participants. Both task performance and brain activity in right MFG after training 30 
predicted better generalized working memory at 6-month follow-up. Furthermore, task performance and brain 31 
activity within bilateral MFG predicted better occupational functioning at 6-month follow-up. No such findings 32 
were observed in the computer games control participants. Working memory impairments in schizophrenia 33 
and its underlying neural correlates in MFG can be improved by intensive computerized cognitive training; 34 
these improvements generalize beyond the trained task and are associated with enduring effects on cognition 35 
and functioning 6 months after the intervention. 36 

© 2014 Published by Elsevier Inc. 



40 

42 Introduction 

43 Individuals with schizophrenia experience prominent working 

44 memory deficits that have deleterious functional consequences (Green 
Q2 et al., 2000; Takahashi et al., 2005 ; Tan, 2009). Compared to healthy par- 

46 ticipants, they show both hypoactivation (Barch et al., 2001; Carter 

Q3 et al., 1998; Perlstein et al., 2003; Stone et al., 1998; Weinberger and 

48 Berman, 1 996) and hyperactivation (Callicott et al., 2000) of dorsolater- 

49 al prefrontal cortex (i.e., bilateral middle frontal gyri) when performing 

50 different working memory tasks, indicating abnormal and inefficient re- 

51 cruitment of prefrontal neural resources as working memory demands 

52 increase (Callicott et al., 2000; Minzenberg et al., 2009). In a meta- 

53 analytic review across 124 studies, working memory deficits were 
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consistently found in schizophrenia patients regardless of stimulus 54 

modality, indicating that they may represent a cardinal cognitive 55 

endophenotype of the illness (Lee and Park, 2005). Enhancement of 56 

working memory is now seen as a critical treatment target, but has 57 

thus far not been amenable to psychopharmacologic interventions 58 

(Buchanan et al., 2005; Goldberg et al., 2007; Mishara and Goldberg, Q4 

2004; Vinogradov etal., 2013). 60 

Four prior studies have examined both the behavioral and prefrontal 61 

cortical activation effects of several forms of cognitive remediation for 62 

working memory dysfunction in participants with schizophrenia 63 

(Bor et al., 2011; Haut et al., 2010; Wexler et al., 2000; Wykes et al., 64 

2002): Wexler et al. (2000) studied eight patients before and after 65 

10 weeks of computerized verbal working memory exercises; Wykes 66 

et al. (2002) studied six patients receiving 40 h of therapist coaching 67 

in executive functioning versus six patients in occupational therapy; 68 

Bor et al. (2011 ) studied eight patients receiving 28 h of computerized 69 

cognitive remediation therapy on a verbal and a spatial N-back task 70 



http://dx.doi.org/l 0.101 6/j.neuroimage.2014.05.057 
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71 versus nine patients receiving no additional treatment; and Haut et al. 

72 ( 201 0) studied nine patients receiving 25 h of computerized training 

73 on a word N-back task versus nine patients receiving group-based social 

74 skills training. All four studies showed increased prefrontal activation as 

75 a result of cognitive remediation; additionally, Haut et al. (2010) 

76 showed that the nine patients who received word N-back training also 

77 improved performance on an animal picture N-back task which corre- 

78 lated with increased activation in bilateral prefrontal regions. However, 

79 increased prefrontal activation may not necessarily always be indicative 

80 of increased prefrontal efficiency (Koch et al., 2006), particularly in light 

81 of mixed findings of both prefrontal hypoactivation and hyperactivation 

82 in schizophrenia patients compared with healthy participants (Callicott 

83 et al., 2000; Perlstein et al., 2003). Thus, despite the promising findings 

84 from earlier cognitive remediation studies, the brain mechanisms un- 

85 derlying critical behavioral changes remain unclear. 

86 In an earlier study, we showed that intensive cognitive training of 

87 auditory/verbal, visual and social cognitive processes generalized to 

88 improvement in an untrained reality monitoring task and increased me- 

89 dial prefrontal cortical (mPFC) activation during performance of this 

90 task (Subramaniam et al., 2012). While these findings showed that the 

91 neural system impairments of schizophrenia are not immutable, several 

92 questions were unanswered. The use of a reality monitoring task did not 

93 allow us to probe lateral prefrontal cortical functioning and enhance- 

94 ment of verbal working memory— which was the target of a significant 

95 portion of the cognitive training exercises. Thus, while our findings 

96 suggested that medial prefrontal cortical regions came "on-line" after 

97 training in support of enhanced reality monitoring performance, we 

98 were not able to investigate whether or not training enhanced capacity 

99 and/or efficiency in key neural systems that were directly targeted 

100 by the exercises, nor whether any such enhancement generalized to 

101 improved clinical and functional status. 

102 In the present study, we sought to address these questions. We 

103 performed fMRI during an untrained N-back working memory task 

104 before and after schizophrenia patients were randomized either to in- 

105 tensive computerized cognitive training of auditory /verbal, visual and 

106 social cognitive processes or to a rigorously matched computer games 

107 control condition. We hypothesized that, compared to the control 

108 condition, subjects who underwent cognitive training would show: 

109 1) Improvements on the untrained letter N-back task, suggesting 
no generalization of the effects of training. 

in 2) Restoration of more normal brain-behavior relationships between 

112 middle frontal gyrus activation and N-back working memory accura- 

113 cy, indicating improved lateral prefrontal system efficiency. 

114 3) An association between working memory gains and lower disorga- 

1 15 nized symptoms, suggesting an impact of cognitive training on clinical 
no status. 

117 4) An association between working memory gains and behavioral 
lis improvements at 6-month follow-up, indicating enduring benefits 

119 of intensive cognitive training. 

120 Methods and materials 

121 Participants and procedure 

122 Thirty clinically stable volunteer schizophrenia patients (SZ: mean 

123 age = 41 years; education = 13 years; IQ= 103; illness duration = 

124 19.4 years) who were willing to undergo fMRI, were recruited from 

125 our randomized clinical trial of cognitive training in schizophrenia 

126 (ClinicalTrials.gov NCT00312962). This subset of participants who 

127 were willing to undertake serial fMRI received the same intervention 

128 and all the same behavioral neuropsychological assessments as partici- 

129 pants in the parent trial (Fig. 1 ). These participants who completed fMRI 

130 were also matched on demographic variables (i.e., age, education, IQ) to 

131 participants in the parent trial. The participants and training procedure 

132 are identical to those described in Subramaniam et al. (2012). We report 



here the results of a working memory fMRI experiment investigating 133 

dorsolateral prefrontal cortical systems, in contrast to our prior report 134 

on the results of a reality-monitoring experiment investigating medial 135 

prefrontal cortical systems (Subramaniam et al., 2012). 136 

SZ participants who underwent fMRI were matched to 15 healthy 137 

comparison participants (HC) at a group level on age, gender, and 138 

education (Table 1 ). SZ participants were stratified by age, education, 139 

gender, and symptom severity and then randomly assigned to either ac- 140 

tive computerized cognitive training (SZ-AT), or a control condition of 141 

commercial computer games (SZ-CG), performed for 80 h. SZ subjects 142 

were blind to group assignment. There were no significant differences 143 

in medications between the two patient groups at baseline and no sig- 144 

nificant medication changes (dosage change < 10%) during the study 145 

(Table 2). SZ participants also underwent clinical and neuropsychologi- 146 

cal assessments by personnel blind to group assignment, at baseline, 147 

after the intervention, and at 6-month follow-up (Table 3). 148 

At baseline, two HC participants felt too claustrophobic to remain in 149 

the scanner, and provided only behavioral data. All other participants 150 

were scanned using fMRI while performing the N-back task. Sixteen 151 

weeks later, 15 SZ-AT, 13 SZ-CG, and 12 HC participants completed a 152 

second fMRI N-back session. One SZ-AT and 1 SZ-CG were unavailable/ 153 

unwilling to perform the fMRI N-back task at the second time point, 154 

and fMRI data from 1 HC was later excluded due to poor signal. Six 155 

months later, 13 SZ-AT and 12 SZ-CG participants returned for cognitive 156 

and clinical re-assessment 157 

Assessments 158 

Symptom severity in schizophrenia was assessed with the Positive 159 
and Negative Syndrome Scale (PANSS), which rates each symptom on 160 
a scale of 1 (absent) to 7 (extreme) (Kay et al., 1987). Verbal working 161 
memory was assessed at 6-month follow-up with the letter-number 162 
span from the MATRICS neurocognitive battery (Nuechterlein et al., 163 
2008), a verbal working memory test in which respondents hear strings 164 
of letters and numbers and repeat these to the administrator in a partic- 165 
ular order. Real-life functioning was assessed with the duality of 166 
Life Scale (QLS) (Bilker et al., 2003). The QLS is a semi-structured inter- 167 
view that assesses functioning during the preceding 4 weeks on a scale 168 
of 0 = virtually absent to 6 = adequate functioning, and is used to 169 
reference the general well-being of individuals in their day-to-day 170 
environment. Research staff who conducted neurocognitive testing 171 
or PANSS and QLS interviews first completed extensive training on 172 
testing/interviewing and scoring criteria of individual items (e.g., scoring 173 
videotaped sessions, observation of sessions conducted by experienced 174 
staff, and participating in mock sessions). Intraclass correlation coeffi- 175 
cients (ICCs) were greater than 0.85 for the PANSS and QLS total 176 
and subscale scores. The MATRICS batteiy demonstrates an ICC of 0.79 177 
for working memory (Keefe et al., 201 1 ). 178 

Computerized cognitive training 179 

The SZ-AT participants completed two sequential modules of adap- 180 
tive computerized cognitive training exercises, 1 h a day for 80 h 181 
over 16 weeks. SZ-AT subjects first participated in a module of auditory/ 182 
verbal processing exercises (http://www.positscience.com/our- 183 
products/brain-fitness-program), for 1 h a day for a total of 50 h 184 
(10 weeks). Next, SZ-AT participants completed a module of visual 185 
processing exercises (http://www.positscience.com/our-products/ 186 
demo), together with a module of computerized emotion identification 187 
exercises, composed of training in facial emotion recognition and theo- 188 
ry of mind (MindReading, MicroExpressions Training Tool, Subtle 189 
Expressions Training Tool; Baron-Cohen et al., 2003; Eckman, 2003) 190 
for 1 h a day for a total of 30 h (6 weeks). The auditory and visual exer- 191 
cises were continuously adaptive: they first established the precise 192 
parameters within each stimulus set required for an individual subject 193 
to maintain 80% correct performance, and once that threshold was 194 
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A. Parent Trial 



Total Enrolled: 1 1 8 
Withdraw During Baseline Assessment: 31 
Totol Ecndomizedi 87 



SZ-AT Group, SO Hours 

Total randomized: Ah 
Non-Completers: 6 
Completers: 40 



SZ-CG Group, 80 Hours 

lotal randomized: A 
Non-Completers: 7 
Completers: 34 



B. fMRj Study Trial 



Total Enrolled from Parent Trial: 30 SZ 
(16 SZ-AT and 14 SZ-CG) 



SZ-AT Group, 80 Hours of 
Computerized Training 

fMRI Completers: 1 5 



SZ-CG Group, 80 Hours 
of Computer Games 

fMRI Completers: 1 3 



Total Enrolled: 15 HC 







HC Group, 80 Hours of 
No Training 

fMRI Completers: 1 2 



C. fMRI Study Protocol 



Baseline 



Six Months 

after the 
Intervention 



HC 


Assessment 


No Training 


Asscssmeoi 


No Training 


Assessment 


Assessment 


SZ-CG 


Assessment 


Computer Games 
(50 hours) 


Awessmen: 


Computer Games 
(30 hours) 


Assessment 


Assessment 


SZ-AT 


Assessment 


Auditory Module 
(50 hours) 


Assessment 


Visual and Social 
Cognitive Module 
(30 hours) 


Assessment 


Assessment 




O 








o 


O 



Clinical and Neuropsychological Assessments 



fMRI: N-Back Working Memory Task 



D. fMRI Task Design 



Rest 



Ready? 



24 s 



2s 



I 500ms I 5Q0ms I 500ms I 



Rest Block 



Task Block (1 minute) 



Fig. 1. Flow chart of fMRI N-back trial and study design in relation to the parent trial. A. Parent trial. B. fMRI study trial C. fMRI study protocol D. fMRI task design. 
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4 

t.i.i Table 1 

tl.2 Demographics (mean, SD) of healthy comparison (HC), active training schizophrenia 
tl.3 subjects (SZ-AT), and control condition computer games schizophrenia subjects (SZ-CG) 
tl.4 at baseline. 



tl.5 


Baseline 


HC (N = 15) 


SZ-AT (N = 


16) 


SZ-CG (JV = 


14) 


p value" 1 


tl.6 


Age 


44.27 (SD = 11.2) 


40.69 (SD = 


12.7) 


41.21 (SD = 


9.48) 


0.24 


tl.7 


Education 


13.93 (SD = 1.44) 


13.19 (SD = 


2.45) 


13.36 (SD = 


1.82) 


0.70 


tl.8 


Gender 


11 M,4F 


12M.4F 




10M.4F 







tl.9 a One-way ANOVAs revealed no significant difference in age or education between the 
three subject groups at baseline. 



195 determined, task difficulty increased systematically and parametrically 

196 as performance improved. The social cognition training was partially 

197 adaptive, in that difficulty level increased progressively as participants 

198 successfully completed blocks of trials at a given difficulty level. The de- 

199 sign and implementation of this approach was informed by research 

200 demonstrating impairments in schizophrenia in basic auditory and vi- 

201 sual perceptual processes, as well as in higher-order auditory and visual 

202 working memory, and social cognitive functions (e.g., Green, 1996; 

203 Javitt, 2009; Javitt et al., 2000). (See Supplementary Methods for a com- 

204 plete description of the cognitive training exercises.) 



In the computer games control condition, SZ-CG participants 205 
systematically rotated through 16 different commercially available com- 206 
puter games (e.g. clue-gathering and visual-spatial puzzle games such as 207 
Hangman, Tic-Tac-Toe, Tetris, Checkers, Dominoes, Solitaire, etc.) for a 208 
total of 80 h over 16 weeks. In each session, SZ-CG participants 209 
completed 4 of the 16 computer games for 15 min per computer 210 
game. The control condition was designed to allow for non-specific 211 
motivation and engagement without providing constrained, intensive, 212 
and adaptive training on specific cognitive operations. Subjects rated 213 
both conditions as equally entertaining on self-report questionnaires, 214 
and subjectively found both conditions to be equally beneficial (Fisher 215 
et al., 2009); a prior study found excellent maintenance of the study 216 
blind with this protocol (Keefe et al., 2011). (See Supplementary Q5 
Methods for a complete listing of all of the computer games used in 218 
the control condition). 219 

Staff exposure during the intervention was kept to a minimum: staff 220 
aided all subjects to start each session and paid them at the end of each 221 
session, but did not provide any coaching. All participants received 222 
$5 for each day of study participation, a bonus $20 for 5 consecutive 223 
days of participation, and a bonus $50 at the completion of each module. 224 
Payment was contingent on study participation and not performance. 225 



t2.1 


Table 2 








t2.2 


Medication profile of active training schizophrenia subjects (SZ-AT) and control condition computer games schizophrenia subjects (SZ-CG) at baseline. 




t2.3 




SZ-AT (Af = 16) 


SZ-CG (N = 14) 


p value 


t2.4 


Antipsychotic medication 3 








t2.5 


1 st generation (N) 


0 


2 


0.23 


t2.6 


2nd generation (N) 


11 


12 


0.61 


t2.7 


Multiple (N) 


1 


0 


0.99 


t2.8 


No antipsychotic (N) 


4 


0 


0.25 


t2.9 


Other psychiatric medication 








t2.10 


Antidepressants or mood stabilizers (AT) 


9 


5 


0.48 


t2.11 


Benzodiazepines (N) 


4 


6 


0.46 


t2.12 


Anticholinergics (N) 


2 


3 


0.65 


t2.13 


Mean chlorpromazine (CPZ) equivalents' 3 


478 (SD = 380) 


410 (SD = 445) 


0.61 


12.14 


Mean cogentin equivalents 1 


0.73 (SD = 0.82) 


1.33 (SD = 2.89) 


0.42 


t2.15 


a Fisher's exact test (two-tailed) revealed no significant differences in the number of antipsychotic medication or other psychiatric medication between the two patient groups at 



baseline. 1st generation antipsychotic medication = thioridazine; 2nd generation antipsychotic medication = aripiprazole, clozapine, olanzapine, quetiapine, risperidone, 
ziprasidone. 

ta.16 b Two sample two-tailed f-tests revealed no significant differences in mean CPZ equivalents between groups (Andreasen et al., 2010). 

t2.i7 c Two sample two-tailed t-tests revealed no significant differences in mean cogentin equivalents (Minzenberg et al., 2004). All patients were clinically stable, and there was no 
change in medication at 16 weeks compared to baseline in either group. 



ts.i Table 3 

t3.2 Clinical symptoms, occupational functioning and neuropsychological working memory performance (mean, SD) of active training schizophrenia subjects (SZ-AT), and control condition 
t3.3 computer games schizophrenia subjects (SZ-CG) at baseline, 16 weeks and 6 months after the intervention. 



t3.4 




SZ-AT 


SZ-CG 


p value 


t3.5 


Baseline 








t3.6 


Overall clinical symptom severity (PANSS) 


2.57 (SD = 0.67) 


2.49 (SD = 0.53) 


0.63 


t3.7 


Positive symptom severity (PANSS) 


2.92 (SD = 1.02) 


2.81 (SD = 1.15) 


0.80 


t3.8 


Negative symptom severity (PANSS) 


2.25 (SD = 0.97) 


2.26 (SD = 0.86) 


0.97 


t3.9 


Disorganized symptom severity (PANSS) 


2.16 (SD = 0.61) 


2.59 (SD = 0.81 ) 


0.12 


t3.10 


Occupational functioning (QLS) 


2.15 (SD = 1.46) 


1.5 (SD = 1.51) 


0.28 


t3.ll 


Verbal working memory (MATRICS) 


-0.78 (SD = 0.90) 


-0.81 (SD = 0.98) 


0.94 


t3.12 
t3.13 


16 weeks 








t3.14 


Overall clinical symptom severity (PANSS) 


2.59 (SD = 0.68) 


2.30 (SD = 0.51) 


0.43 


t3.10 


Positive symptom severity (PANSS) 


2.61 (SD = 1.00) 


2.56 (SD = 1.18) 


0.87 


t3.1C 


Negative symptom severity (PANSS) 


2.43 (SD = 0.81) 


2.35 (SD = 0.61 ) 


0.74 


t3.17 


Disorganized symptom severity (PANSS) 


1.74 (SD = 0.41) 


2.04 (SD = 0.81 ) 


0.23 


t3.18 


Occupational functioning (QLS) 


2.25 (SD = 0.86) 


1.78 (SD = 0.97) 


0.18 


t3.19 
t3.2() 


6 months after the intervention 








t3.21 


Overall clinical symptom severity (PANSS) 


2.59 (SD = 0.82) 


2.38 (SD = 0.64) 


0.48 


t3.22 


Positive symptom severity (PANSS) 


2.72 (SD = 1.37) 


2.52 (SD = 1.42) 


0.39 


t3.23 


Negative symptom severity (PANSS) 


2.73 (SD = 1.38) 


2.37 (SD = 0.99) 


0.18 


t3.24 


Disorganized symptom severity (PANSS) 


1.89 (SD = 0.92) 


2.19 (SD = 0.82) 


0.44 


t3.25 


Occupational functioning (QLS) a 


3.08 (SD = 1.66) 


1.83 (SD = 1.3) 


0.049 


t3.26 


Verbal working memory (MATRICS) 


-0.17 (SD = 0.90) 


-0.55 (SD = 1.18) 


0.38 


t3.27 


1 SZ-AT showed improved real-world occupational functioning 6 months after the intervention when compared to the SZ-CG group. 
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226 N-back working memory task 

227 While in the scanner, participants completed 0-back, 1-back and 

228 2-back tasks consisting of serially presented letters. In the 0-back task, 

229 which measures visual attention, participants had to press the left 

230 button when the letter on the current trial was an "X" and had to 

231 press the right button for all other letters. On the 1-back and 2-back 

232 tasks, participants had to press the left button when the letter on the 

233 current trial matched the letter 1 or 2 trials back, and had to press the 

234 right button for all other letters. The 2-back task has been shown to 

235 reliably activate the DLPFC in HC and SZ participants (Haut et al., 

236 201 0; Royer et al., 2009). In order to specifically measure neural activity 

237 related to 2-back working memory demands, we contrasted activity on 

238 2-back working memory trials with 0-back visual attention trials. For 

239 each of the three N-back tasks, participants performed four 25-trial 

240 blocks, alternating with blocks of rest. The scanning duration for each 

241 N-back task was 6 min 31s. N-back working memory training was not 

242 a component of any of the cognitive training exercises. 



5 

N-back task: Behavioral statistical analyses 243 

Signal detection theoretic d-prime analyses were performed by calcu- 244 

lating the hit rate and the false alarm rate (FA), converting each measure 245 

to a z-score, and subtracting the FA from the hit rate in order to differen- 246 

tiate sensitivity during accurate performance from response bias. We 247 

performed an outlier correction using a winsorization procedure for 248 

values above/below a 2 standard deviation (SD) (Wilcox, 2005). There 249 

was one outlier in the SZ-AT participants at 16 weeks, who performed 250 

more than 2 SD above the mean on the 2-back task. This outlier was 251 

winsorised to ensure that all results were normally distributed. 252 

N-back task: fMRI acquisition 253 
Visual stimuli were presented with E-Prime (http://www.pstnet. 254 
com/eprime.cfm) and back-projected onto an LCD projector. Partici- 255 
pants viewed the screen using a mirror attached to the head coil and 256 
made finger-press responses on a fiber-optic response pad. fMRI was ac- 257 
quired on a 3-T General Electric Signa LX 15 scanner and eight-channel 258 
head coil, using a spiral echo-planar sequence (TR = 1 s; TE = 30 ms; 259 



•fill 



p < .001 , v =200 voxels 



Left Middle Frontal 
Gyrus (L.MFG) 
signal increase in 
HC and SZ 
subjects 



Left Inferior 
Frontal Gyrus 
(L.IFG) signal 
increase in HC and 
SZ subjects 



Left Insula signal 
increase in HC and 
SZ subjects 



Right Middle 
Frontal Gyrus 
(R.MFG) signal 
increase in HC and 
SZ subjects 



Right Inferior 
Frontal Gyrus 
(R.IFG) signal 
increase in HC and 
SZ subjects 



Right Insula 
signal increase 
in HC and SZ 
subjects 



Fig. 2. Pre-training (baseline) whole-brain clusters of activation in our combined sample of healthy comparison (HC) and schizophrenia (SZ) subjects for the 2-back minus 0-back contrast, 
significant at a p value of 0.001, and cluster size of at least 200 voxels in volume. 
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A. Behavior: mean accuracy averaged across 4 task blocks for each condition in HC 
and SZ subjects a 




■ HC (N=15) 



□ SZ(N=30) 



B. Associations between signal change for the 2-back minus 0-back contrast with 2-back 
performance in HC subjects b 
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Fig. 3. Pre-training (baseline) performance and brain signal differences between healthy comparison (HC) and schizophrenia (SZ) subjects during a letter N-back task. A. Behavior: mean 
accuracy averaged across four task blocks for each condition in HC and SZ subjects. 3 B. Associations between signal change for the 2-back minus 0-back contrast with 2-back performance in 
HC subjects. b C. Associations between signal change for the 2-back minus 0-back contrast with 2-back performance in SZ subjects. 11 . ^Significant difference between HC and SZ subjects on 
thel-back(F= 5.04, d/= l,p = 0.03) and 2-back (F = 6.49, df= l,p = 0.01 ) tasks at baseline. b Mean signal in bilateral MFG correlated with 2-back accuracy in HC subjects. There 
was no association between signal change in any of the ROIs with 2-back accuracy in SZ subjects. 



Please cite this article as: Subramaniam, K., et al., Intensive cognitive training in schizophrenia enhances working memory and associated prefron- 
tal cortical efficiency in a manner that drives..., Neurolmage (2014), http://dx.doi.Org/l0.l016/j.neuroimage.20l4.05.057 



ARTICLE IN PRESS 



K. Subramaniam et al I Neurolmage xxx (2014) xxx-xxx 

C. Associations between signal change for the 2-back minus 0-back contrast 
with 2-back performance in SZ subjects c 



4.5 
4.0 
3.5 
3.0 
2.5 
2.0 
1.5 
1.0 
0.5 
0.0 




r=.21,p=.27 



1 



Mean L.MFG Signal for 2-back 
minus 0-back across 30 SZ 
Subjects at Baseline 




L.MFG R.MFG 




-10 12 
Mean R.MFG Signal for 2-back 
minus 0-back across 30 SZ 
Subjects at Baseline 



4.5 
4.0 
3.5 
3.0 
2.5 
2.0 
1.5 
1.0 
0.5 
0.0 



r=.22, p=.24 
« ♦ 



-2 -1 0 1 2 3 4 5 

Mean L.IFG Signal for 2-back 
minus 0-back across 30 SZ 
Subjects at Baseline 




45 -i r= .19, p = .33 

40 1 ♦ ♦ 

35 

3.0 
2.5 
2.0 
1.5 
1.0 
0.5 
0.0 

-2-10123 
Mean R.IFG Signal for 2-back 
minus 0-back across 30 SZ 
Subjects at Baseline 



4.5 
4.0 
3.5 
3.0 
2.5 
2.0 
1.5 
1.0 
0.5 
0.0 



= .27, p=/ 

l 



Mean L. Insula Signal for 2- 
back minus O-back across 30 
SZ Subjects at Baseline 



0.1 



« u> 0.05 



«) s 



-0.05 



JL 



II 



L. Insula R. Insula 



.13,p=.50 



4.5 
4.0 
3.5 
3.0 
2.5 
2.0 
1.5 
1.0 
0.5 
0.0 



Mean R. Insula Signal for 2-back 
minus 0-back across 30 SZ 
Subjects at Baseline 



■k 



Fig. 3 (continued). 



260 flip angle = 60, matrix = 64 x 64, FOV = 22 cm, 14 slices, 6 mm thick- 

261 ness). Image analysis was performed using SPM2 software (www.fil. 

262 ion.ucl.ac.uk/spm). 

263 N-back task: fMRI statistical analyses 

264 Images were realigned to correct for motion artifacts using a six- 

265 parameter affine transformation, normalized to a standard stereotaxic 

266 space ( Montreal Neurological Institute Template ) using a 1 2-parameter 

267 affine/non-linear transformation, and spatially smoothed with a 1 0 mm 

268 FWHM Gaussian kernel. Data were submitted to a whole-brain general 

269 linear model analysis, fitting a reference canonical hemodynamic 

270 response function to each task block and to each rest block. Image 

271 intensity was scaled to the mean global intensity of each time series. Re- 

272 ported results for 2-back versus 0-back whole-brain working memory 

273 load in our combined sample of HC and SZ participants are significant 

274 at a p value of 0.001 uncorrected for multiple comparisons, and cluster 

275 size of at least 200 voxels in volume (Fig. 2). Our whole-brain analysis 

276 revealed activation across bilateral frontal clusters in middle frontal 

277 gyri (MFG), inferior frontal gyri (IFG) and insula that additionally 



survived whole-brain multiple comparison correction of FWE p < 0.05 278 
(see Supplementary Table 1, Fig. 1 ). Next, we selected the ROIs from a 279 
different study (Perlstein et al., 2001) that were confirmed by our 280 
whole-brain analysis and that used the same population (HC and SZ par- 281 
ticipants) and the same task contrast (2-back minus 0-back) as the pres- 282 
ent study in order to minimize any bias and avoid non-independence 283 
issues (rather than picking the peaks from the working memory load 284 
effects from our whole-brain analyses). This procedure is consistent 285 
with Poldrack (2007). We selected the following ROI centroids reported 286 
in Perlstein et al. (2001 ): R.MFG (38, 27, 24 Talairach coordinates, BA 287 
46/9), L.MFG (-36, 38, 23 Talairach coordinates, BA 46/9), R.IFG 288 
(49, 10, 23, BA44), LIFG (-47, 7, 23, BA44), R.Insula (35, 15, 8) and 289 
L.Insula (-40, 10, 10). (We used the centroids from the Perlstein et al. 290 
(2001 ) paper as it has a slightly larger sample size than the Perlstein 291 
et al. (2003) paper, but we note that when we use coordinates from the 292 
Perlstein et al. (2003) study it does not change any of our reported find- 293 
ings. We chose not to use ROIs from the Glahn et al. (2005) meta-analysis 294 
since this paper amalgamates data across a very wide range of N-back 295 
tasks using letters, numbers, objects, location, and auditory non-words; 296 
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297 the focus of our experiment was specifically on 2-back vs. 0-back in 

298 a letter N-back task. We calculated mean beta signals within a 10-mm 

299 radius spherical volume around each of the centroids from the Perlstein 

300 et al. (2001) paper, during 2-back versus 0-back conditions for each 

301 group (HC, SZ-CG, SZ-AT) and for each session (baseline, 16 weeks). 

302 The mean beta signals for each ROl were then entered into repeated- 

303 measures group-by-session ANOVAs in SPSS to compare change in 

304 2-back working memory signal from baseline to 16 weeks in each 

305 group. Signal change from baseline to 16 weeks was correlated with be- 

306 havioral change in 2-back performance for each group. 



Results 307 

Baseline behavioral and flARI findings 308 

One-way ANOVAs of task accuracy revealed that SZ participants 309 
were significantly impaired on 1-back (F = 5.04, df = 1, p = 0.03) 310 
and 2-back tasks (F = 6.49, d/= 1, p = 0.01) compared to HC partici- 311 
pants (Fig. 3A). The effect size of the overall accuracy difference 312 
between HC and SZ subjects at baseline was 0.77 for the 1-back and 313 
0.76 for the 2-back task. 314 



A. Change in accuracy for 2-back in SZ-AT, SZ-CG and HC subjects at 
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Fig. 4. Cognitive training effects: performance and brain signal change at 16 weeks versus baseline between active training schizophrenia subjects (SZ-AT), computer games control 
schizophrenia subjects (SZ-CG), and healthy comparison subjects (HC). A. Change in accuracy for 2-back in SZ-AT, SZ-CG and HC subjects at 16 weeks versus baseline. a B. Mean signal 
change and brain-behavior associations at 16 weeks versus baseline. b . a Repeated-measures ANOVA revealed a group-by-session interaction in d-prime scores for the 2-back 
task at 16 weeks compared to baseline, driven by the SZ-AT subjects (F = 3.37, df = 2, p = 0.045). b Mean signal change in R.MFG correlated with change in 2-back accuracy (R.MFG: 
r= 0.69, d/ = 13,p = 0.004) in SZ-AT subjects at 16 weeks versus baseline. 
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315 When compared to HC participants, SZ participants revealed 

316 hypoactivation in the L.MFG only (F = 4.61, df = 1, p = 0.04). Mean 

317 beta signal calculated across all voxels within bilateral MFC and L.IFG 

318 ROls correlated with accurate 2-back performance in HC participants 

319 (Fig. 3B). There was no correlation in HC participants between accurate 

320 2-back performance and mean beta signal in R.IFG or bilateral insula 

321 (Fig. 3B). None of the 6 ROIs were associated with 2-back performance 

322 in SZ participants (Fig. 3C). This suggests a pattern of prefrontal cortical 

323 inefficiency in which activation in bilateral MFC does not support 

324 2-back working memory performance in SZ participants. After baseline 

325 fMRI, SZ participants were randomly assigned to either computerized 

326 cognitive training or the computer games control condition. 

327 N-back performance after the intervention 

328 After 16 weeks in which SZ participants performed either 80 h of 

329 active training (SZ-AT) or computer games (SZ-CG), all participants 

330 participated in a second fMRI session. A repeated-measures ANOVA 

331 (HC, SZ-CG, SZ-AT) revealed a group-by-session effect in d-prime 

332 scores for the 2-back task during the second session compared to the 

333 first (F = 3.37, df= 2, p = 0.045) (Fig. 4A), and a marginal group-by- 

334 session effect for the 1-back (F = 3.17, d/= 2, p = 0.054). The signifi- 

335 cant group-by-session effect for the 2-back was driven by the SZ-AT 

336 participants, who performed significantly better after cognitive training 

337 versus baseline when compared to SZ-CG participants (F = 5.91 , df= 1 , 

338 p = 0.022), and when compared to HC participants (F = 4.33, df = 1, 

339 p = 0.047). There were no differences between sessions for SZ-CG 

340 and HC participants on 2-back performance (F = 0.05, df = 1, p = 

341 0.83). Within-group paired t-tests confirmed that the SZ-AT partici- 

342 pants performed significantly better on the 2-back after training versus 

343 baseline ( t = 2.6, df = 1 4, p = 0.02 ) as well as on the 1 -back after train- 

344 ing versus baseline (t = 2.11, df = 14, p = 0.05). After 16 weeks, one- 

345 way ANOVAs revealed that there was no significant difference between 

346 the SZ-AT and HC subjects on either 1 -back or 2-back accuracy (1-back: 

347 F= 0.01, df= l,p = 0.94; 2-back: F = 0.26, df = l,p = 0.62). Nei- 

348 ther SZ-CG nor HC participants showed significant improvement on 

349 either the 1-back (SZ-CG: t = 0.36, df = 12, p = 0.73; HC: t = 0.10, 

350 df = 12, p = 0.92) or the 2-back (SZ-CG: t = 0.71, d/ = 12, p = 0.49; 

351 HC: t = 0.63, df = 12, p = 0.54) in the second session, suggesting that 

352 the improvements observed in the SZ-AT group were specific to the train- 

353 ing and extended beyond practice effects on the task (Table 4). Together, 

354 these data indicate that cognitive training of auditory, verbal, visual, and 

355 social cognitive processes generalized to improved performance on an 

356 untrained N-back working memory task in SZ participants such that 

357 they began to "normalize" to the performance level of HC subjects. 

358 fMRI findings after the intervention 



ROIs (all p values > 0.15). Assessments of repeatability for the control 368 

groups at baseline and at 16 weeks, assessed with intraclass correlation 369 

coefficients (ICCs), were greater than 0.90 for each of the ROIs tested in 370 

the HC group and were greater than 0.80 for each of the regions in the 371 

SZ-CG group. 372 

Interestingly, in SZ-AT participants, the improvement in 2-back per- 373 

formance showed a strong association with the change in R.MFG signal 374 

(r = 0.69, df = 13, p = 0.004), similar to HC participants at baseline. 375 

Additionally, Fisher r-to-z transformation indicated that the strength 376 

of the correlation between R.MFG signal with 2-back performance in 377 

SZ-AT subjects at 1 6 weeks was significantly different from the correla- 378 

tion at baseline (z = 1.69, p = 0.04, one-tailed), indicating enhanced 379 

right prefrontal efficiency as a result of training. Interestingly, signal 380 

change in R.MFG was correlated with signal gains in two other regions: 381 

LIFG (r = 0.61, p = 0.01) and L.MFG(r = 0.82,p = 0.0002). Thus, it is 382 

possible that improved 2-back performance is related to increased 383 

connectivity between R.MFG with L.MFG and L.IFG. Signal change in 384 

the remaining ROIs did not correlate with the increase in 2-back perfor- 385 

mance in SZ-AT participants (Fig. 4B). SZ-CG participants did not show 386 

any association between change in 2-back performance and mean sig- 387 

nal change in any of the ROIs after 80 h of computer games versus base- 388 

line (all p values > 0.15). These findings suggest that training-enhanced 389 

efficiency of R.MFG signal may be associated with increased functional 390 

connectivity between bilateral MFC regions, which may help to support 391 

better 2-back performance in SZ-AT participants. 392 

Association of behavioral and fMRI findings with clinical measures after 393 

cognitive training 394 

Overall, symptom ratings were low in this clinically stable group of 395 

SZ participants (average rating slightly over 2, mild) at baseline and at 396 

1 6 weeks. There was no change in positive or negative symptom ratings 397 

at 16 weeks compared to baseline in either the SZ-AT group or in the 398 

SZ-CG group (all p values > 0.20). However, after training, SZ-AT partic- 399 

ipants had lower disorganized symptom ratings compared to baseline 400 

(r = 2.43, df = 14, p = 0.03 ). Furthermore, lower disorganized symp- 401 

torn severity levels after training in SZ-AT participants was correlated 402 
with improved 2-back performance levels (r = — 0.57, df = 13, p = 
0.03). Two-back performance after training was not correlated with pos- 
itive or negative symptoms (p values > 0.40). There was no association 

between severity of disorganized symptoms and mean beta signal in 406 

any of the ROIs in SZ-AT participants after training (all p values > 0.15). 407 

There was no association between 2-back performance or mean beta 408 

signal in any of the six ROIs with disorganized symptoms in SZ-CG par- 409 

ticipants (all p values > 0.60). These data indicate that SZ participants 4io 

who made greater improvements on the 2-back task also had lower 411 

disorganized symptoms after training. 412 



403 
404 
405 



359 In order to investigate between-group differences at 16 weeks ver- 

360 sus baseline, mean beta weights from the 2-back versus 0-back contrast 

361 were extracted across all the voxels within each ROI for each group 

362 and for each session (i.e., baseline, and 16 weeks), and submitted to 

363 repeated-measures ANOVAs in SPSS. There was a significant group-by- 

364 session effect in only two regions, the LMFG and LIFG, driven by the 

365 SZ-AT participants during the second session versus the first (LMFG: 

366 F = 4.23, df = 2, p = 0.02; LIFG: F = 5.69, df = 2, p = 0.007). There 

367 was no group-by-session increase in signal observed in any of the other 



Findings 6 months after the intervention 



413 



Working memory gains as assessed by the letter-number sequenc- 414 
ing task were sustained in SZ-AT participants at 6-month follow-up 415 
as compared to baseline (t = 2.98, df = 12, p = 0.01). In addition, 416 
improved 2-back performance and mean beta signal in the R.MFG ROI 417 
immediately after training showed a significant correlation with better 418 
letter-number sequencing performance at 6 months (2-back d-prime: 419 
r = 0.62, df= 11, p = 0.02; R.MFG: r = 0.60, df = 11, p = 0.03 ) 420 



t4.1 
t4.2 
t4.3 



t4.5 
t4.6 
t4.7 



Table 4 

Performance on the 1-back and 2-back tasks (mean, SD) of healthy control subjects (HC), control condition computer games schizophrenia subjects (SZ-CG), and active training schizo- 
phrenia subjects (SZ-AT) who completed the intervention. 



1 -back accuracy at baseline 



1-back accuracy at 16 weeks 



2-back accuracy at baseline 



2-back accuracy at 16 weeks 



HC 

SZ-CG 
SZ-AT 



3.20 (SD : 
2.89 (SD : 
2.01 (SD : 



0.57) 
0.81) 
1.69) 



3.23 (SD : 
2.86 (SD = 
3.21 (SD : 



0.85) 
0.69) 
0.81) 



3.30 (SD 
2.22 (SD 
1.88 (SD 



: 1.65) 
: 1.15) 
: 0.93) 



3.02 (SD : 
2.04 (SD : 
2.75 (SD : 



1.73) 
1.05) 
1.02) 
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A. Association with verbal working memory (Letter Number Sequencing Task) 3 
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B. Association with Quality of Life Occupational Functioning subscale b 
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Fig. 5. Association of 2-back performance and brain signal change after training with cognitive and clinical measures in active training schizophrenia subjects (SZ-AT) assessed 6 months 
after cognitive training was completed. A. Association with verbal working memory (letter-number sequencing task). 3 B. Association with Quality of Life Occupational Functioning 
subscaleA ^Better performance on the 2-back and R.MFC signal in SZ-AT subjects immediately after 16 weeks of cognitive training were associated with better verbal working memory 
assessed 6 months after cognitive training was completed (2-back: r = 0.62, df = 11, p = 0.02; R.MFC: r = 0.60, df = 1 1, p = 0.03). b Better performance on the 2-back and bilateral 
MFG signal in SZ-AT subjects immediately after 1 6 weeks of cognitive training were associated with better occupational functioning assessed 6 months after cognitive training was 
completed (2-back: r = 0.57,d/= 11, p = 0.04; R.MFG: r = 0.58, df= 11, p = 0.04; LMFG: r = 0.57,d/= 11, p = 0.04). 



421 (Fig. 5A). Improved 2-back performance after training were also associ- 

422 ated with lower disorganized symptoms at 6 months (r = —0.55, 

423 df = 1 1 , p = 0.05 ), even though disorganized symptom severity overall 

424 was not significantly lower at 6 months when compared to baseline 

425 (t = 0.78, df = 12, p = 0.40). In the 12 SZ-CG participants, there was 

426 no increase in working memory performance at 6 months compared 

427 to baseline; further 2-back performance after 16 weeks of computer 

428 games did not correlate with better working memoiy or lower disorga- 

429 nized symptoms (all p values > 0.30) at 6 months. 

430 There was an increase in QLS Occupational Functioning ratings 

431 at 6 months compared to baseline in the SZ-AT (t = 2.52, df = 12, 

432 p = 0.03) but not the SZ-CG group (t = 0.57, df = 11, p = 0.58). 

433 Two-back performance and mean beta signal in R.MFG and L.MFG 

434 ROIs after training were correlated with these better QLS Occupational 

435 Functioning ratings at 6 months in the SZ-AT group (Fig. 5B) but not 

436 in the SZ-CG group (all p values > 0.20). 



437 Discussion 

438 We performed an fMRl study of verbal working memoiy using 

439 the letter N-back task before and after a double-blind randomized 

440 controlled trial of 80 h of intensive computerized training of component 

441 auditory/verbal, visual, and social cognitive processes in adults with 



schizophrenia compared to patients in a computer games control condi- 442 
tion. We found that the SZ participants who underwent training 443 
showed: 444 

1 ) Significant improvement in accuracy during the untrained 2-back 445 
working memoiy task. 446 

2) "Restoration" of significant brain-behavior associations between 447 
R.MFG signal and 2-back accuracy, similar to that seen in healthy 448 
participants at baseline. 449 

3) Significant associations between 2-back accuracy and R.MFG signal 450 
after training, with improved letter-number sequencing perfor- 451 
mance 6 months later. 452 

4) Significant associations between 2-back accuracy and in R.MFG and 453 
L.MFG signal after training, with better occupational functioning 454 
6 months later. 455 

No such improvements or associations were seen in the schizophre- 456 
nia participants who underwent the control computer games condition, 457 
indicating that these findings were not due to practice effects, nor to 458 
non-specific effects of attention, motivation, computer exposure, or 459 
social engagement. 460 

To our knowledge, this is the first study to demonstrate improved 461 
working memoiy function and increased neural system efficiency 462 
in individuals with schizophrenia after intensive cognitive training 463 
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464 as compared to a rigorously matched control condition, and to relate 

465 those improvements to better working memory and occupational func- 

466 tioning at 6-month follow-up. These data are consistent with our prior 

467 findings of training-induced increases in medial prefrontal cortical signal 

468 associated with better reality monitoring performance and with better so- 

469 cial functioning at 6-month follow-up (Subramaniam et al., 2012). In the 

470 present experiment, we show that the effects of training occur in lateral as 

471 well as medial prefrontal systems with slightly different long-term effects. 

472 At baseline, schizophrenia participants showed both reduced 

473 prefrontal capacity as well as prefrontal inefficiency on the 2-back 

474 task. At a low processing load, on the 0-back task, schizophrenia partic- 

475 ipants showed no impairments in performance when compared to 

476 healthy participants, but revealed reduced accuracy during the higher- 

477 load 2-back task. Interestingly, consistent with the Minzenberg et al. 

478 (2009) meta-analysis, we found that although schizophrenia patients 

479 revealed a similar qualitative pattern of cortical-subcortical activation 

480 (extending from bilateral MFG to insula) to that of healthy participants 

481 at baseline, they revealed quantitative activation differences within 

482 LMFG. Specifically, we found that individuals with schizophrenia 

483 showed reduced activation in L.MFG on the 2-back task, which may 

484 indicate that they had hit MFG "ceiling" capacity on the higher-load 

485 2-back task. Intensive cognitive training enhanced both 2-back perfor- 

486 mance and LMFG activation such that there was no longer any quanti- 

487 tative difference in activation levels between healthy comparison 

488 subjects and schizophrenia participants, suggesting that training may 

489 have enhanced prefrontal capacity. 

490 Schizophrenia subjects also showed no association between 2-back 

491 accuracy and MFG signal at baseline, unlike what was seen in the healthy 

492 comparison subjects, consistent with a picture of prefrontal cortical in- 

493 efficiency during increased working memory demands (Deserno et al., 

494 2012; Karlsgodt et al., 2007; Minzenberg et al., 2009; Potkin et al., 

495 2009). This is in agreement with the conclusions of Minzenberg et al. 

496 (2009) that if prefrontal activation does not support task performance, 

497 this likely indicates disrupted or inefficient processing. We found that 

498 1 6 weeks of intensive training enhanced R.MFG efficiency such that sig- 

499 nal became correlated with improved 2-back performance; the strength 

500 of this correlation was significantly greater than the correlation at base- 

501 line, suggesting enhanced right prefrontal efficiency. We also found that 

502 signal change in R.MFG was correlated with signal gains in two other re- 

503 gions: L.IFG and LMFG. Thus, it may be possible that improved 2-back 

504 performance and enhanced R.MFG efficiency is related to increased 

505 connectivity within prefrontal neural networks. Moreover, increases 

506 in both 2-back performance and R.MFG signal immediately after train- 

507 ing predicted better verbal working memory performance on the 

508 letter-number sequencing test 6 months later, as well as better occupa- 

509 tional functioning. Together, these findings suggest that the improved 

510 efficiency in the R.MFG circuitry we observed in the training group rep- 

511 resents a robust and adaptive plastic change that generalizes to endur- 

512 ing behavioral gains. 

513 Perhaps not surprisingly, better 2-back working memoiy perfor- 

514 mance after training was associated with lower disorganized symptoms, 

515 consistent with prior studies which have shown a strong association be- 

516 tween impaired working memoiy in schizophrenia and disorganization 

517 (Sanz et al., 2009; Yoon et al., 2008). Further, our finding that training- 

518 induced improvements in 2-back performance and bilateral MFG signal 

519 levels were associated with better occupational functioning at 6 months 

520 is consistent with prior research indicating that verbal working memoiy 
Q6 is a strong predictor of functional outcome in schizophrenia (e.g., Green, 

522 1996). It is also an interesting counterpoint to our prior report of im- 

523 proved reality monitoring performance and increased signal in medial 

524 PFC as associated with better ratings on QLS social functioning at 

525 6 months (Subramaniam et al., 2012). It appears that intensive cognitive 

526 training of auditory/verbal, visual, and social cognitive processes induces 

527 improved efficiency in several critical and perhaps partially dissociable 

528 higher-order prefrontal circuits, each with distinct implications for 

529 long-term real-world functioning. 



We do not know which specific components of the cognitive training 530 
contributed most to the improvements we observed. However, the 531 
auditory /verbal learning exercises we employed for 50 h of training 532 
(the first module) did drive significant improvements in verbal working 533 
memoiy and verbal learning and memoiy, assessed with MATRICS mea- 534 
sures, as reported previously, which endured at the 6-month follow-up 535 
(Fisher et al., 2009, 2010). It thus appears likely that the heavy emphasis 536 
on training in auditory /verbal processing contributed significantly to 537 
behavioral improvement on the 2-back task as well as improvement 538 
in R.MFG signal efficiency that supports 2-back performance; however 539 
changes in visual working memoiy were not assessed with MATRICS 540 
measures after the second module, and therefore at present, the contri- 541 
bution of this form of visual training alone (or in sequence) to visual 542 
working memory changes remains unknown. Additional limitations of 543 
the study include the modest sample sizes and the unrepresentative na- 544 
ture of the study sample, which included schizophrenia participants 545 
who were higher functioning than the typical clinical sample. We may 546 
have been underpowered with the current sample sizes to detect signif- 547 
icant improvements in L.MFG signal efficiency supporting improved 548 
2-back performance, although current results revealed marginally 549 
significant correlation effects. Participants were paid for their participa- 550 
tion and were motivated to engage in training, which was intensive in 551 
nature and occurred in a well-controlled laboratory environment. It 552 
is not known whether similar results can be generated in real-world 553 
treatment settings. 554 

We acknowledge that while our data show considerable potential, 555 
additional research is needed to establish the necessary and sufficient 556 
elements of training, the critical neural mechanisms that support 557 
long-term adaptive behavioral change, and the optimal dissemination 558 
approaches that will lead to widespread and enduring improvements 559 
in quality of life and functional outcome. 560 
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